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[METHOD FOR OPERATING A 
PRE-CRASH SENSING SYSTEM IN 
A VEHICLE HAVING A 
COUNTERMEASURE SYSTEM 
USING STEREO CAMERAS] 

Cross Reference to Related Applications 



ffl The present invention is related to U.S. Applications (Attorney Docket No. 201 



w 



0534/FGT-l 533PA) entitled "Method For Operating A Pre-Crash Sensing System In A 



"'^i Vehicle Having A Countermeasure System" and (Attorney Docket No. 201 -0633/FGT- 

nj 1 534PA) entitled "Method For Operating A Pre-Crash Sensing System In A Vehicle 

% Having A Countermeasure System Using A Radar and Camera" filed simultaneously 

•W 

fU herewith and hereby incorporated by reference. 

y Background of Invention 

[0001] Technical Field 

[0002] The present invention relates to pre-crash sensing systems for automotive 

vehicles, and more particularly, to pre-crash sensing systems having countermeasures 
operated in response to pre-crash detection. 

[0003] Background 

[0004] Auto manufacturers are investigating radar, lidar. and vision-based pre-crash 
sensing systems to improve occupant safety. Current vehicles typically employ 
accelerometers that measure decelerations acting on the vehicle body in the event of a 
crash. In response to accelerometers, airbags or other safety devices are deployed. 
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[0005] In certain crash situations it would be desirable to provide information before 
forces actually act upon the vehicle when a collision is unavoidable. 

[0006] Remote sensing systems using radar, lidar or vision based technologies for 

adaptive cruise control, collision avoidance and collision warning applications are 
known. These systems have characteristic requirements for false alarms. Generally, 
the remote sensing system reliability requirements for pre-crash sensing for 
automotive safety related systems are more stringent than those for comfort and 
convenience features, such as, adaptive cruise control. The reliability requirements 
even for safety related features vary significantly, depending upon the safety 
countermeasure under consideration. For example, tolerance towards undesirable 
activations may be higher for activating motorized belt pre-tensioners than for 
functions such as vehicle suspension height adjustments. Non-reversible safety 
counter m u re s , _i n clud I nq,ajr.baq s . require extremely reliable sensing systems for 
pre-crash activation. However, the size of objects is typically not taken into 
consideration in the activation of such countermeasure devices. Also, such systems 
may generate unintentional or undesirable activations when the host vehicle is 
maneuvering at high speeds, low speeds, or when traveling on a sharp curved road. 
When a vehicle is traveling on a curved road, for example, objects outside of the lane 
of travel may be determined to be potential crash objects. 



yj [0007] It would therefore be desirable to provide a pre-crash sensing system that 
reduces unintentional or undesirable activations. 



[0008] It would also be desirable to provide a system that takes into consideration the 
size of the object detected. 

Summary of Invention 

[0009] The present invention provides an improved pre-crash sensing system that 

reduces false activations and activates a countermeasure in response to the size of the 
object detected. 

[001 0] In one aspect of the invention, a method for operating a pre-crash sensing system 
for an automotive vehicle having a countermeasure system comprises: 
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[001 1] establishing a decision zone relative to the vehicle; 

[001 2] detecting an object within the decision zone using a vision system; 

[001 3] determining an object distance and relative velocity using a vision system; 

[0014] determining an object size; and 

[001 5] activating the countermeasure system in response to the object size and relative 
velocity. 

[001 6] In a further aspect of the invention, a method for operating a control system 
comprises: establishing a decision zone relative to the vehicle; detecting an object 
within the decision zone; determining an object distance and relative velocity; 
determining an object size; and activating the countermeasure system in response to 
the object size and relative velocity. 



[001 7] One advantage of the invention is that the size and orientation of the object may 
be taken into consideration. This is extremely useful if the object is another 
^ automotive vehicle such as a sport utility, car or truck. By knowing the size of the 

Pj vehicle, different countermeasures and different countermeasure activation modes 

may be chosen. 



[001 8] Another advantage of the invention is that unintentional or inadvertent activation 
of countermeasure devices is minimized. 



[001 9] Other advantages and features of the present invention will become apparent 
when viewed in light of the detailed description of the preferred embodiment when 
taken in conjunction with the attached drawings and appended claims. 

Brief Description of Drawings 

/ 

[0020] Figure^s a block diagrammatic view of a pre-crash sensing system according to 
the present invention. 

/ 

[0021] Figure 2/is a top view of an automotive vehicle with the radar part of a pre-crash 
sensing system that includes two narrow beam radar sensors. 

[0022] Figure ^'^^ automotive vehicle with the radar part of a pre-crash 
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sensing system according to the present invention that employs four wide beam radar 
sensors. 

[0023] Figure 4 is a top view of an automotive vehicle having a stereo pair of cameras 28, 
30 mounted behind the rear view mirror. 

[0024] Figure 5 i/atop view of an automotive vehicle having another alternative object 
sensor 1 8 jricluding a radar 22"" and vision system 26"". 

[0025] Figure 6 i/a side view of an automotive vehicle indicating the vision sensors line 
of sight in f^nt of the vehicle. 



[0026] Figure 7yi a flow chart of a method for operating the pre-crash sensing system 
according to the present invention. 

Detailed Description 

[0027] In the following figures the same reference numerals will be used to identify the 
same components. While the present invention is illustrated with respect to several 
types of object sensors, various types and combinations of object sensors may be 
used as will be further described below. 

[0028] Referring now to Figure 1 . a pre-crash system 1 0 has a controller 1 2. Controller 
1 2 is preferably a microprocessor-based controller that is coupled to a memory 1 4 
and a timer 16. Memory 14 and timer 16 are illustrated as separate components from 
that of controller 1 2. However, those skilled in the art will recognize that memory 1 4 
and timer 16 may be incorporated into controller 12. 

[0029] Memory 14 may comprise various types of memory including read only memory, 
random access memory, electrically erasable programmable read only memory, and 
keep alive memory. Memory 14 is used to store various thresholds and parameters as 
will be further described below. 

[0030] Timer 1 6 is a timer such as a clock timer of a central processing unit within 

controller 1 2. Timer 1 6 is capable of timing the duration of various events as well as 
counting up or counting down. 



[0031] 



A remote object sensor 1 8 is coupled to controller 1 2, Remote object sensor 1 8 
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generates an object signal in the presence of an object within its field of view. Remote 
object sensor 1 8 may be comprised of one or a number of types of sensors including 
a radar 22, a lidar 24, and a vision system 26. Vision system 26 may be comprised of 
one or more cameras, CCD or CMOS type devices. As illustrated, a first camera 28 and 
a second camera 30 may form vision system 26. Both radar 22 and lidar 24 are 
capable of sensing the presence and the distance of an object from the vehicle. When 
used as a stereo pair, cameras 28 and 30 acting together are also capable of detecting 
the distance of an object from the vehicle. Alternately, as will be further described 
below, radar 22 or lidar 24 may be used to detect an object within a detection zone 
and vision system 26 may be used to confirm the presence of the object within the 
decision zone and to provide the size of the object to controller 1 2. In another 
embodiment of the invention cameras 1 and 2 alone may use established triangulation 
techniques to determine the presence of an object and the distance from the vehicle 
as well as the object's size which may include area, height or width, or combinations 
W thereof. In the case of vision systems, the object relative velocity information can be 



Uj obtained from numerical differentiation techniques. 

s 

[0032] A speed sensor 32 is also coupled to controller 1 2. Speed sensor 32 may be one 



of a variety of speed sensors known to those skilled in the art. For example, a suitable 
speed sensor may include a sensor at every wheel that is averaged by controller 1 2. 



Preferably, controller translates the wheel speeds into the speed of the vehicle 



Suitable type of speed sensors 32 may include, for example, toothed wheel sensors 
such as those employed on anti-lock brake systems. 

[0033] vehicle trajectory detector 34 is also coupled to controller 1 2. The vehicle 

trajectory detector 34 generates a signal indicative of the vehicle traveling on a curved 
road. The vehicle trajectory detector 34 may comprise various numbers or 
combinations of sensors but preferably include a yaw rate sensor 36, vehicle speed 
sensor 32 and a steering wheel angle sensor 38. Yaw rate sensor 36 preferably 
provides the yaw rate of the vehicle about the center of gravity of the vehicle. The yaw 
rate measures the rotational tendency of the vehicle about an axis normal to the 
surface of the road. Although yaw rate sensor is preferably located at the center of 
gravity, those skilled in the art will recognize that the yaw rate sensor may be located 
in various locations of the vehicle and translated back to the center of gravity either 
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through calculations at the yaw rate sensor 36 or through calculations within 
controller 1 2 in a known manner. 

[0034] Steering wheel angle sensor 38 provides a steering wheel angle signal to 

controller 1 2. The steering wheel angle signal corresponds to the steering wheel angle 
of the hand wheel of the automotive vehicle. As will be further set forth below, the 
yaw rate sensor 36 and the vehicle speed sensor 32 or the steering wheel angle 
sensor 38 alone, or the above sensors in combination, may be used to indicate a 
curved road. 

[0035] Controller 1 2 is used to control the activation of a countermeasure system 40, 
Each countermeasure may have an individual actuator associated therewith. In that 
case, controller 1 2 may direct the individual countermeasure actuator to activate the 
countermeasure. Various types of countermeasure systems will be evident to those 
skilled in the art. Examples of a countermeasure within a countermeasure system 
include occupant belt pretensioning, bumper height changing, braking, the pre- 
arming of internal airbags, the deployment of external or internal airbags, pedal 
control, steering column position, head restraint and knee bolster control. Preferably, 
controller 1 2 is programmed to activate the appropriate countermeasure in response 
to the inputs from the various sensors. As will be described below, the controller may 
choose the countermeasure based on the type and orientation of the target vehicle. 

[0036] Referring now to Figure 2, a vehicle 50 is illustrated having a decision zone in 

front thereof. The width of the decision zone is a predetermined quantity depending 
upon the width of the host vehicle. The longitudinal dimensions of the danger zone 
depend upon the relative velocity coverage requirements and the vision system 
coverage capabilities. An oncoming vehicle 54 is illustrated as well as an ongoing 
vehicle 56 traveling in the same direction as vehicle 50. The vision system covers the 
entire decision zone 52. As can be seen, a first radar 22A and a second radar 22B are 
used to direct signals through decision zone 52. When an object enters the decision 
zone, the radar sensors are able to detect its presence and also obtain its relative 
velocity with respect to the host vehicle. When the object enters the decision zone the 
present invention is activated. 

[0037] Referring now to Figure 3, a similar view to that shown as in Figure 2 is illustrated. 
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In this embodiment, four wide beam radar sensors 22a", 22", b22c", and 22d" are 
used. With this multiple wide beam radar sensor arrangement, using established 
triangulation techniques, it is possible to obtain distance, bearing and relative velocity 
information of objects entering the decision zone. The same size and position of 
vehicles 54 and 56 are illustrated. 

[0038] Referring now to Figure 4, a stereo pair of cameras 28. 30 are used on vehicle 50. 
By using a stereo pair of cameras, the presence, size and distance of the object from 
the vehicle may be determined. The object relative velocity information can be 
obtained from the numerical differentiation of the object position information. 

[0039] Referring now to Figure 5, a vehicle 50 pre-crash sensing system shows a 

scanning radar or lidar 22"" in combination with a vision system 26". Radar 22" can 
thus detect the presence of an object within decision zone, while camera 26"" can 
classify the object and verify the size and/or orientation of the object. 

^ [0040] Referring now to Figure 6, automotive vehicle 50 is illustrated having a vision 
W system 26 mounted at the back of a rear view mirror 62. A typical line of sight of the 

ECi vision system, which defines the near side of the vehicle longitudinal decision zone in 

1 Figures 2 through 5 is shown. Radar sensors are typically mounted in front of the 

vehicle, behind the front grill or behind the front bumper fascia and have fields of 
coverage, which are unrestricted by the host vehicle's front end. 



[0041] Referring now to Figure 7, a method according to the present invention starts at 

step 70. In step 72, the decision zone in front of the vehicle is monitored with the 

remote object detector. In the present example, the decision zone is monitored with a 

vision system that includes a stereo pair of cameras. In step 72 the vision system is 

used to first detect an object within the decision zone. If an object has not been 

detected in decision zone, step 72 is again executed. If an object has been detected 

by the vision system, step 76 is executed. In step 76, the host vehicle velocity (V ) is 

H 

determined. In this example the host vehicle is vehicle 50 described above. In step 78, 

a low speed threshold value V ^ and a high speed threshold value V ^ are established. 

In step 78 the host vehicle velocity (i.e. speed) (V ) is compared with a first 

H 

threshold (V ^ ) and a second threshold (V ^ ). The first threshold is a low speed 
threshold and the second threshold is a high speed threshold. In the present example, 
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the low speed threshold is set at 24 kph (kilometers per hour) and the high speed 
threshold is set at 80 kph. Thus, if the hosn^ehi^^ low speed 

threshold or greater than the high speed threshold, step 72 is again executed. If the 
host vehicle speed is between the low speed threshold and the high speed threshold, 
then step 80 is executed. Step 78 helps minimize inadvertent, unintentional and non- 
useful deployments during real world driving situations. 

[0042] In step 80 the relative velocity (V ) and the distance D from the vision system are 

R 

determined for the closing object. In step 82 a relative velocity threshold value V is 

established. For example, for a V value of 80 kph, if the closing velocity (V ) is 

RU R 

not less than 80 kph, then step 72 is again executed. In step 82 if the closing velocity 

(V ) is less than V (80 kph), step 84 determines the host vehicle trajectory radius 
R RU 

of curvature (R ^ ) from the yaw rate sensor, vehicle speed sensor, and the host 
vehicle trajectory radius of curvature (R ^ ) from the steering wheel sensor after 
appropriate signal conditioning as will be evident to those skilled in the art. In step 
86, the radii of curvature from the yaw rate (R ^ ) and from the steering wheel sensor 
(R ^ ) are validated to ensure they are within a proper range and are not erroneous 
readings. One method for validation is to compare previous values for the radius of 
curvature to determine if a value has changed at a rate greater than that physically 
achievable by the automotive vehicle. A minimum value is selected between the radius 
of curvature from the yaw rate and from the steering wheel sensor. This minimum 
value is the estimated radius of curvature (R ^ ). 

[0043] In step 88, a radius of curvature threshold value (R ^ ) is established. The 

estimated radius of curvature (R ^ ) is compared with the threshold. If the estimated 
value is not greater than the threshold then step 72 is again executed. If the 
estimated radius of curvature value (R ^ ) is greater than the radius of curvature 
threshold, then step 90 is executed. Step 88 prevents the system from operating when 
the vehicle is traveling on a very curved trajectory to prevent an unintentional 
deployment. 



In step 90, the relative velocity dependent countermeasure activation distance (D 
^ ) is determined as a function of the closing relative velocity, a device deployment 
time dependent variable (T ), and an update rate (T ) of the sensing system. That 



[0044] 



D 
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is, D =V (T +T ). In step 92, if the relative distance D from the host vehicle is 
C R D U 

not less than or equal to the countermeasure activation distance (D ^ ) step 72 is 
again executed. If the relative distance D is less than or equal to countermeasure 
activation distance (D ), step 94 is executed. In step 94 object size threshold (S ) 
is established. In step 94 the object size is compared with an object size threshold (S 

). If the object size is not greater than the size threshold (S ), then step 72 is 
executed. If the object size is greater than the threshold, step 96 is executed. In step 
94 object size may correspond to various characteristics of the object. For example, 
the object height may be determined. The object width may also be determined. By 
knowing both the object width and object height, the object area may also be 
determined. When viewing object height, the difference between a small sports car, a 
full size sedan, a sport utility or light truck, and a heavy duty truck may be 
distinguished. 



4^ [0045] In step 96. the object may be classified. The object may be classified into various 
classes depending on the object size and other characteristics as set forth in step 94. 



Also, the size of the object may be classified for orientation. The orientation may 



ry 



ultimately lead to a different decision as to which of the countermeasures may be 
activated and may also define the mode of activation of the selected countermeasures. 



y By looking at the object area or the object height and width as a function of time, a 

front view of a sport utility vehicle or a car may be distinguished from the side view. 



3 V 



[0046] In step 97, object size and orientation information is compared to object 

classification based deployment criteria for the elements of the countermeasure 
system. If the classification based deployment criteria are not satisfied then step 72 is 
again executed. 

[0047] In step 98, when the classification based activation criteria are met, appropriate 
elements of the countermeasure system are activated in response to the various 
inputs described above. In step 100, the method ends after deployment. 

[0048] While particular embodiments of the invention have been shown and described, 
numerous variations and alternate embodiments will occur to those skilled in the art. 
Accordingly, it is intended that the invention be limited only in terms of the appended 
claims. 
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